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ABSTRACT:  We^ave  previously  discussed  Che  simulation  of  networks  of 
queues  for  general  characteristics  of  passage  times  of  a single  Job 
type,  using  Che  regenerative  method  for  simulation  and  the  idea  of 
tracking  a distinguished  Job  through  the  network.-.  We  consider  here, 

1 r fi'H  ^*r^%from  a somewhat  different  point  of  view^  passage  time  simulation  in 
I — " closed  networks  of  queues  having  multiple  Job  types.  -Our^ results 

provide  a means  of  obtaining,  from  a single  replication,  point  and 
interval  estimates  for  passage  times  of  the  several  Job  types.  They 
also  yield  a statistically  more  efficient  estimation  procedure  for 
passage  tines  of  a single  Job  type. 
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1.  INTRODUCnON 

Wo  Uavo  conaldorud  in  Cwu  piovtoua  papers  (Igloliact  and  Shedior,  [9], 
[10])  Che  problem  of  simulating  closed  and  iinice  capacity  open  networks 
of  queues,  respectively,  for  general  characteristics  of  passage  times.  A 
passage  time,  defined  formally  in  Section  3,  is  Che  time  for  a Job  to 
traverse  a portion  of  the  network.  In  general,  the  calculation  of  passage 
times  comprises  random  sums  of  queueing  times.  In  a closed  network  of 
queues,  when  Che  passage  time  is  a complete  circuit  or  loop,  we  refer  to 
it  as  a response  time.  This  paper  presents  a method  for  estimation  of 
passage  times  in  networks  having  multiple  Job  types,  i.e.,  networks  with 
stochastically  non-identical  Jobs. 

For  closed  networks,  we  introduced  in  [9]  the  notion  of  a distinguished 
"marked"  Job.  After  arbitrarily  selecting  a Job  to  serve  as  Che  marked 
Job,  we  observe  in  the  simulation  Che  times  at  which  passage  (or  response) 
times  of  this  Job  start  and  terminate.  These  observations  are  the  basis 
for  construction  of  confidence  intervals  for  the  quantities  of  interest 
associated  with  Che  limiting  passage  time.  In  [9]  we  considered  passage 
times  in  networks  with  a single  Job  type.  Under  consideration  here  are 
networks  with  multiple  Job  types  and  the  estimation  of  individual  and 
Joint  characteristics  of  passage  times  over  the  several  Job  types.  The 
type  of  a Job  may  influence  its  routing  through  Che  network  as  well  as 
its  service  requirements  at  each  center.  For  expository  convenience,  we 
assume  chat  there  are  only  two  Job  types  in  Che  network  and  we  nuirk  one 
Job  of  each  type.  By  tracking  these  two  Jobs,  we  are  able  to  produce  from 
a single  replication  confidence  intervals  for  a variety  of  passage  time 
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characcerisclcs.  The  mechod  of  this  paper  can  also  be  applied  to  networks 
with  only  a single  job  type;  the  result  is  an  alternative  estimation  scheme 
to  chat  proposed  in  [9]. 

2.  NE-nraRKS  OF  QUEUES  AND  ASSOCIATED  STOCHASTIC  PROCESSES 

We  consider  closed  networks  of  queues  with  a finite  number  of  Jobs, 

N,  of  two  types,  and  assume  that  there  are  [resp.  Jobs  of  type  1 
[resp.  type  2]  with  Nj^+N^^N.  In  each  network  there  are  a finite  number 
of  service  centers,  s,  and  a finite  number  of  Job  classes,  c.  All  Jobs 
retain  their  Job  type,  but  may  change  class  as  they  traverse  the  network. 
(Think  of  type  1 Jobs  as  cubes  and  type  2 Jobs  as  spheres,  and  let  Job 
classes  correspond  to  different  colors.  Then  we  permit  Jobs  to  change 
color,  but  not  shape.)  Upon  completion  of  service  at  center  1,  a type  v 
Job  of  class  J goes  to  center  k and  changes  to  class  I with  probability 
,.  We  assume  that  for  v-1,2,  : isi.kSs,  iSj.JiSc}  is  a 

given  irreducible  Markov  matrix. 

The  service  times  and  service  discipline  at  each  service  center  are 
as  in  19]  with  the  exception  that  they  may  also  depend  on  Job  type.  We 
briefly  review  the  situation.  At  each  service  center  Jobs  queue  and 
receive  service  according  to  a fixed  priority  scheme  among  classes  and 
types,  which  scheme  can  vary  from  center  to  center.  Each  center  operates 
as  a single  server,  processing  Jobs  of  a fixed  type  and  class  according 
to  a fixed  service  discipline.  All  service  times  in  the  network  are 
mutually  Independent,  and  at  each  center  have  a distribution  with  an 
exponential  stage  representation  (Cox  [2],  p.  314)  with  parameters  which 
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nay  depend  on  the  service  center,  type  and  class  of  Job  being  serviced, 
and  the  "state"  of  the  entire  system.  (We  exclude  zero  service  times 
occurring  with  positive  probability.)  A job  in  service  may  or  may  not  be 
pre-empted  (according  to  a fixed  procedure  for  each  center)  if  another 
job  of  higher  priority  joins  the  queue  at  the  center. 

We  restrict  the  present  discussion  to  networks  in  which  all  service 

times  are  exponentially  distributed,  and  deal  with  distributions  having 

an  exponential  stage  representation  in  the  usual  way  by  the  method  of 

stages  (cf.,  e.g.,  Gelenbe  and  Muntz  [3]).  To  characterize  the  state  of 

the  system  at  time  t,  we  let  S^(t)  denote  the  (type,  class)  pair  of  the 

job  receiving  service  at  center  i at  time  t,  i*>l, 2, . . . ,s.  If  there  are 

no  jobs  at  center  i at  time  t,  we  set  S^(t)"(0,0).  We  denote  by 

j j^(i) , . . . (i)  the  (type,  class)  pairs  served  at  center  i ordered  by 

decreasing  priority,  and  let  (t) , . . . (t)  denote  the  number  of 

^1  Jk(i) 

jobs  in  queue  at  time  t of  the  various  (type,  class)  pairs  served  at 
center  4..  We  mark  one  job  of  each  of  the  two  types  in  order  to  measure 
their  passage  or  response  times.  As  in  [9],  we  view  the  M jobs  as  being 
completely  ordered  in  a linear  stack,  and  let  the  vector  Z(t)  be  given 
by : 

Z(t)  - (cj^^  (t) cJ^\t),S  (t);...; 

Jk(l)  h ^ 

(t) cJ®^t),S  (t))  . 

The  linear  stack  again  corresponds  to  the  order  of  components  in  the  vector 
Z(t)  after  ignoring  any  zero  components.  Within  a (type,  class)  pair  at 
a center,  jobs  waiting  appear  in  the  linear  stack  in  the  order  of  their 


4 


arrival  in  the  canter,  the  latest  to  arrive  being  closest  to  the  top  of 
the  stack.  Let  N^(t) , v-1,2,  denote  the  position  from  the  cop  in  this 
linear  stack  of  the  type  v marked  job.  Then  the  state  vector  of  Che 
network  Is 


X(t)  - (Z(t),Nj^(t).N2(t)),  tiO  . 


Under  Che  exponential  service  time  and  Markovian  routing  assumptions,  the 
process  ji^>{X(c)  :c2:0}  Is  an  irreducible  continuous  time  Markov  chain  with 
finite  state  space  E. 

3.  SIMULATION  FOR  PASSAGE  TIMES 

We  specify  the  passage  (or  response)  times  for  the  two  types  of  Jobs 
by  eight  subsets  of  E;  A^^^^  A^'^^  for  v-1,2.  The  sets  A^'^^ 

and  A^'^^  [resp.  B^'^^  ] determine  when  to  start  (resp.  stop]  the  clock 

measuring  a particular  passage  time  for  the  type  v marked  job.  We  denote 
Che  jump  Clfflss  of  by  {n^:n20},  and  in  terms  of  these,  we  define  four 
sequences  of  random  times:  {Sj'*^:j2:0}  and  {Tj^^:j2:l},  for  V“l,2.  The 
start  [resp.  termination]  time  of  the  jch  passage  time  for  Che  type  V 
marked  job  is  denoted  by  (resp.  Formally,  we  have  for  v«l,2, 

} , jiO 

T^''^  - inf{nj^>sj]jJ:  X(njj)£B^''\  } , j^l  . 

(v)  (v)  (v) 

The  jth  passage  time  for  Che  type  v marked  job  is  Pj  “Tj 

Note  Chat  the  definition  of  these  times  is  a special  case  of  Che 

corresponding  times  defined  in  (9).  This  specialization  still  allows  us 
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Co  deal  with  passage  times  in  most  networks  of  interest.  For  response 
times  of  type  v jobs,  and  for  all  j^l. 

Ac  this  point  we  depart  from  Che  method  given  in  [9].  Let  L(c)  denote 
the  last  state  visited  by  Che  Markov  chain  X before  jumping  to  X(c),  and 
set 


V(t)  - (L(t),X(t)),  t20  . 

The  process  V«{V(t) :tiO}  has  a state  space  F consisting  of  all  pairs  of 
states  (i,j),  i,j££  for  which  a transition  in  X from  state  i to  state  j 
can  occur  with  positive  probability.  In  general,  of  course,  the  size  of 
Che  state  space  F is  larger  chan  Chat  of  E.  The  "Q-matrix"  used  in 
generating  Che  Markov  chain  V can  be  obtained  easily  from  chat  for  X. 

Since  X is  an  irreducible,  positive  recurrent  Markov  chain,  so  is  V. 
Clearly,  the  entrance  times  of  V to  a state  (i,j)€F  correspond  to  the 
times  of  transition  in  X from  state  i to  state  j.  For  a type  v job,  we 
define  two  subsets  of  F according  to: 

=■  {(i,j)£F:  ieA^^\ 

T^'^^  - {(i,j)eF:  . 

Thus  the  entrances  of  V to  [resp.  correspond  to  the  start  (resp. 

termination]  times  of  passage  times  for  the  type  V marked  job.  Of  course 

(v)  (v) 

for  response  times  of  a type  V job,  S =T  . This  new  set-up  involving 
Che  process  V permits  a more  straightforward  consideration  of  passage  (or 
response  times)  chan  was  the  case  in  [9]. 


b 


The  irgumont  employod  tn  18],  Appendix  1,  shows  that  for  v-1,2,  P 


(V) 


(v)  (st)  v(v) 

converges  in  distribution  to  a random  variable  P , denoted  P^|  P 

as  n-**“,  and  that  the  sequence  of  passage  times  for  any  other  Job  of  type 

(v) 

V also  converges  in  distribution  to  the  same  random  variable  P . 

Moreover,  the  sequence  of  passage  times  of  type  v Jobs  (irrespective  of 

Job  identity)  in  the  order  of  start  (or  termination)  also  converges  in 
(v) 

distribution  to  P . Our  concern  is  with  the  estimation  of 
characteristics  associated  with  these  limiting  passage  times. 

Estimation  of  EIR^^^}  and  P{R^^^sx} 

To  illustrate  how  simple  the  passage  time  estimation  problem  becomes 
in  the  setting  of  the  process  V,  we  consider  first  the  estimation  of 
characteristics  of  a limiting  response  time,  R^^\  of  a type  1 Job.  For 
this  estimation  problem,  of  course,  it  is  not  necessary  to  mark  a type  2 
Job.  Since  R^^^  is  a response  time,  We  select  a fixed  state 

of  which  for  convenience  we  designate  state  0,  and  assume  that 

V(0)-0. 


Suppose  first  that  we  wish  to  estimate  E{R^^^}.  The  successive 

entrances  of  V to  constitute  the  start  and  termination  of  response 

times  of  the  type  1 marked  Job.  Let  denote  the  time  between 

the  nth  and  (n+Dst  entrances  to  with  the  0th  entrance  to 

occurring  at  t'O.  Also,  let  {V^:n'0}  denote  the  embedded  Jump  chain 

associated  with  V.  The  random  times  {t  tn^l)  and  (<S  :n-l}  will  denote 
~ n u 

the  lengths  of  Che  successive  0-cycles  (successive  returns  to  the  fixed 


1 


7 


scacd  0)  for  V and  (V^:ni0},  respectively.  Then  the  number  of  response 
times  for  the  type  1 marked  job  in  the  first  0-cycle  of  V is 


6i-l 


- E 


j-0 


^IV 


and  the  sum  of  the  response  times  in  that  cycle  is  simply 


nJ^>-i 


^ < 


(1) 


.(1) 


We  denote  the  analogous  quantities  in  the  kth  0-cycle  by  and  T^. 

Since  V is  a regenerative  process,  ''.te  pairs  of  random  variables 
( ) :ksl}  are  independent  and  identically  distributed  (i.i.d,). 


Provided  that  }»•■»>,  a renewal  argument  (cf.,  [10])  shows  that 


- E{T^}/E{N^^h 


(3.1) 


At  this  point,  the  standard  regenerative  method  arguments  (cf.,  [7])  can 

be  used  to  construct  (based  on  n cycles)  the  point  estimate  and  an 

associated  confidence  interval  for  E{R^^^}.  Here  T"(T,+...+T  )/n  and 

1 n 

. .+N^^^)/n.  For  this  problem,  we  could  also  employ  the 
discrete  time  estimation  method  suggested  by  Hordijk,  Iglehart  and 
Schassberger  [6];  this  would  shorten  the  computation  time  and  Increase 
statistical  efficiency. 

If  we  are  interested  in  the  distribution  function,  P{R^^^Sx}  of  R^^\ 
we  proceed  as  above,  but  define  in  addition  the  i.i.d.  sequence  of  random 
variables  {Y^ck^l},  where,  for  example. 
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n“l  n 

Then  the  point  estimate  of  P{R^^^sx}  is  just  anJ  we  obtain 

confidence  intervals  in  the  usual  way. 


Estimation  of  E{R^^^}  and 

Now  suppose  that  we  wish  to  estimate  the  expected  passage  time  for 
type  2 jobs,  E{R^^^},  as  well  as  Response  times  for  the  type  2 

marked  Job  start  and  terminate  at  the  entrance  times  of  V to  the  set 

(2)  (2)  (2)  (2) 

S “T  . Let  Nj;  denote  the  number  of  entrances  to  S ot  V in  the 

kth  0-cycle.  For  example,  in  the  first  0-cycle 


^1  " ^{V  ■ 

n-0  n 

Although  we  are  able  to  begin  the  simulation  at  the  start  of  a response 
time  for  the  type  1 marked  Job,  in  general  a response  time  for  the  type  2 
narked  job  is  underway  at  time  t"0.  Similarly,  at  the  end  of  a 0-cycle, 
a response  time  for  the  type  1 marked  Job  terminates,  but  a response  time 

for  the  type  2 marked  Job  is  still  underway.  After  n 0-cycles, 

i'*) 

N^“  +...+N^'‘  response  times  for  the  type  2 marked  Job  have  started  and 

the  sum  of  these  response  times  is  approximately  T^+. The  error  in 

this  approximation  is  due  to  the  partial  response  time  at  t~0  which  is 

(2)  (2) 

not  counted  in  +. . .+N^  and  the  last  response  time  which  is  counted, 
but  does  not  terminate  before  the  end  of  the  nth  0-cycle.  Since  the  point 
estimates  and  confidence  intervals  here  are  based  on  large  sample  theory 
(strong  laws  and  central  limit  theorems) , these  errors  are  negligible  for 
n large.  In  fact,  the  errors  due  to  the  two  response  times  at  t~0  and  at 
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t^ke  ouU  ot  Chtf  !t iskulat lou  ruu  compouiiate  tor  uach  ocher.  .\gaiu,  we  hdve 

.2) 

i.t.d.  p**!-*^!*  >3*  random  variables  ):kii;  and  che  ratio  formula 


(J.d) 


1 JN  / >N  ^ —(2) 

provided  that  eCr'"^  Iv^w.  T!ie  point  estimate  of  is  t/N'“  , and  we 

con  use  che  standard  regenerative  aiethod  to  obtain  a confidence  interval. 


Estimation  cf.  E{r''^^  }-E{R^‘h 

Suppose  now  that  we  wish  to  estimate  r^^^-r^“\  where 
and  r'*"  “E{R'“^}.  We  can  take  as  a point  estimate  the  quantity 
ii/N^^^)-vT/N'^“^)  , but  need  a bivariate  central  limit  theorem  in  order  to 
produce  a confidence  interval.  To  this  end,  we  let 

“k  k k 


for  kil.  iWe  take  ail  our  vectors  to  be  column  vectors.)  The  random 
vectors  {^j^:kil}  are  l.i.d.  since  each  is  oi\ly  a function  of  che  kth 
0-cycle.  Kurthermore,  equations  (3.1)  and  (3.1)  imply  that  EiZ^}“0. 
Denoting  the  transpose  of  by  Z^,  let  I“ElZ^Zj^}-{o^j  1 be  the  covariance 
matri.x  of  the  Assuming  that  the  elements  of  E are  finite,  we  have 

che  central  limit  theorem 


i3.  J> 
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where  NlO.I)  is  a auitivar iace  norraai  randora  variable  with  zero  aean  veccor 
d«d  covariance  autrix  We  can  rewrite  equation  (.3.3)  in  the  form 


(3.4) 


Since  } with  probability  one,  we  can  replace  and 

outside  the  braces  by  E{N^^^}  and  E{N^“^}  in  equation  (3.4)  and  not  change 
the  result.  This  is  an  application  of  the  continuous  mapping  theorem 
(c.m.t.);  see  Billingsley  [1],  Theorem  3.1.  Kext  apply  the  c.n.t.  to  this 
altered  form  of  equation  (3.3)  using  the  continuous  mapping 
hiXj^,X2)-(x^/ElN^^^},  x.,/E{n|‘^})  to  obtain 


1/: 

n 


(T/N^^^)-r‘'^^ 

(T/N''‘^)-r^‘^ 


S(0,a^') 


(3.5) 


where  a- (1/E{N^^^ } , l/EiN^-^ }) . Note  that  from  equation  (3.5)  we  could 
construct  a simultaneous  confidence  interval  for  (r^^^r^"^).  Finally, 
a third  application  of  the  c.m.t.  yields 

(n^'‘/a)  (i  (T/N^^^)-(T/N^‘^}-(r^^^-r^‘^]  N(0,1)  (3.6) 

x.’here 

- 2aj^^/(E{Nj^^}E{N^^h)  . 


We  can  use  the  central  limit  theorem  of  equation  (3.6)  to  construct  a 

(1)  (2) 

confidence  interval  for  r -r  , provided  that  an  estimate  for  the 
constant  J is  available.  Using  the  classical  method  (cf.,  Iglchart  [5]), 
we  can  estimate  0 from  the  sequence  of  observations  taken  in  the  n 0-cycles 
of  the  process  V.  This  estimate  for  o appears  in  the  .\ppendix. 
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A special  case  of  Che  siCuaClon  Just  discussed  is  when  Che  cwo  Cypes 

of  Jobs  are  Che  same;  In  Chls  case  chere  Is  only  one  Job  cype,  buc  we 

elecc  CO  mark  Cwo  Jobs.  LeC  r^^^"r^^^»r,  f and  r -(r^^\r^^^). 

n ~n  n n 

Then  we  can  use  Che  mechod  of  mulclple  esclmaces  of  Heldelberger  [4] 
applied  CO  equaClon  (3.5).  For  any  veccor  J^(6^,B2)  wlch  we  have 

(n^^^/o(jg))  (^’r^-r)  N(0,1)  , 

2 A 

where  a (]&)■■]§' )^.  Nexc  we  selecc  chac  value  of  g,  call  ic  jg  , which 

2 A 

minimizes  O (g)  subjecc  Co  jg'e-1,  where  e“(l,l).  Ic  Cums  ouC  Chat  ^ is 

given  by 

;g  “ (1/  (e*a£a'  e)  } (aEe’ ) ^e 

and 

O^(jg)  - l/{e’(aEa')"^e}  . (3.7) 

Since  Jg»(l,0)  is  one  possible  value  of  jg,  using  jg  Is  guaranceed  co  yield 
a variance  reduccion  over  chac  obcained  by  marking  JusC  one  Job.  Again, 
of  course,  we  musc  escimaCe  Che  variance  o (^  ) given  in  equaCion  (3.7) 
from  Che  observacions  recorded. 

EsclmaCion  of  P{R^^^Sx}-P{R^^^Sx} 

Finally,  we  consider  Che  estimaclon  of  P{R^^^Sx}-P{r^^^ Sx)  for  a given 
value  of  X.  This  is  Che  most  difficult  of  Che  problems  we  treat.  Since 
Che  value  of  x is  fixed  throughout  Che  discussion,  in  general  we  suppress 
in  our  notation  Che  dependence  of  x.  Again  we  form  0-cyclcs  based  on  Che 
response  times  for  the  type  1 marked  Job.  Here,  however,  when  a 0-cycle 
ends,  we  do  not  know  whether  Che  response  time  for  the  type  2 marked  Job 
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In  progress  will  be  less  chan  or  equal  Cu  x.  Thus,  with  respect  to  tlie 

response  times  for  the  type  2 marked  Job,  the  Q-cycles  used  previously  do 

not  create  Che  l.i.d.  blocks  needed  to  establish  a central  limit  theorem. 

Instead,  we  form  new  cycles  by  grouping  together  a geometrically 

distributed  number  of  consecutive  0-cycles.  Let  T^-r  lil,  and 

(2) 

Tq^O.  We  let  denote  the  time  of  the  last  entrance  of  V into  S during 
the  ith  O-cycie;  s^  is  the  start  time  of  the  response  time  for  the  type  2 
marked  Job  unden^ay  at  the  conclusion  of  the  ith  O-cycle.  Set  A^"{Tj^-s^>x} 
and  p^-P{A^}.  Since  Che  0-cycles  are  l.i.d.,  the  events  {.\^:iJl}  are 
also,  and  p^~p  for  all  i^l.  We  assume  that  at  the  start  of  the  simulation 
the  value  of  the  response  time  for  the  type  2 marked  Job  underway  is 
greater  Chan  (the  fixed)  x.  This  corresponds  to  the  beginning  of  one  of 
the  new  "super-cycles"  we  are  constructing.  If  we  lot  y denote  a geometric 
random  variable  with  distribution  given  by 


P{Y“n}  - (l-p)"  p,  nil  , 


then  Che  length  of  Che  first  super-cycle  is  simply  t^-T^+'l2+- • 
number  of  response  times  for  the  type  V marked  Job  started  in  this 
super-cycle  is  . Successive  super-cycles  are  defined 

in  an  analogous  fashion.  Define  Che  sequence  {Y||^^^:k^l)  to  be  the  number 
of  response  times  terminating  in  the  kth  super-cycle  which  are  less  than 


or  equal  to  x;  for  example 


’'i'”  ■ k?0  • 

Observe  that  by  the  definition  of  a super-cycle,  Che  first  response  time 
of  Che  type  2 marked  Job  terminating  within  a super-cycle  must  be  greater 
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than  X.  Thus  Che  sequence  of  's  are  i.i.d.  Of  course,  the  Yj^ 
are  i.i.d.  also,  as  are  the  n^^^'s  and  n^^^'s.  We  can  now  form  the 
bivariate  central  limit  theorem  analogous  to  equation  (3.5),  namely 


" L(Y(2>/n(2)j. 


p{r^^^s:x} 


N(0,b(x)£(x)b' (x))  , 


where  )j(x)-(l/E{n|^^ },  1/E{nj^^}),  and  £(x)-{a  (x)}  with 


a^j(x)  - E{[Y^^^-nJ^^P{R^^^Sx}][Y^-’''-n^-’‘'P{R'‘J''ix}]} 
Finally,  by  Che  same  argument  used  in  equation  (3.6),  we  obtain 
(n^'"^ /a(x)  ) [ (Y /n^^^-Y^^^  /n^^^  )- (P{R^^^  Sx}-P{R^^^ Sx})  ] 


a)_„(J)p;„(j). 


N(0,1)  , 


(3.8) 


where 


o^(x) 


(a^^(x)/E^{n^^^})+(a22(x)/E^{n^^''})-(2aj^2('^>''^^"r^^®W^^^^  ' 


.2/_(2) 


a)xp;„<2)- 


We  can  estimate  the  quantity  C7(x)  from  the  observations  in  the  n 
super-cycles  using  the  classical  method;  see  the  Appendix.  Then  we 
construct  confidence  intervals  for  P{R^^^Sx}-P{R^^^Sx}  from  equation  (3.8) 
in  Che  usual  way. 


4.  EXAMPLE  AND  NUMERICAL  RESULTS 

To  illustrate  the  technique  of  the  previous  section  for  estimation  of 
response  times,  we  consider  a simple  closed  network  of  queues  having  two 
types  of  jobs  and  two  service  centers;  see  Figure  1.  There  are  N jobs  in 
the  network,  N^  Jobs  of  type  1 and  N^  jobs  of  type  2.  Upon  completion  of 
service  in  center  1,  a type  v job  joins  the  queue  at  center  1 (with 
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probabllicy  or  (with  probability  joins  the  queue  in  center  2. 

Upon  completion  of  service  at  center  2,  jobs  join  the  queue  at  center  1. 

At  both  service  centers,  type  1 jobs  have  non-preemptive  priority  over 
type  2 jobs.  Jobs  of  the  same  type  at  either  of  the  centers  receive 
service  in  order  of  their  arrival  at  the  center.  We  assume  that  all 
service  times  are  mutually  independent;  jobs  of  type  V at  center  1 receive 
service  which  is  exponentially  distributed  with  parameter  The 

(limiting)  response  time  for  type  V jobs  that  we  consider  in  this 

model  is  the  time  measured  from  when  upon  completion  of  service  at  center  2, 
a type  V job  enters  the  queue  at  center  1,  until  the  next  such  entrance 
by  the  job  into  the  queue  at  center  1. 


In  this  model,  there  are  two  job  classes,  class  1 jobs  at  center  1 
and  class  2 jobs  at  center  2.  E.nch  center  sees  both  job  types,  but  only 
one  job  class.  The  irreducible  Markov  routing  matrices  are  ot  the 

form 


0 


Since  type  1 jobs  have  priority  over  type  2 jobs  at  both  centers,  the 
(type,  class)  pairs  ordered  by  decreasing  priority  are  jj^(i)"(l,i)  and 
j2(i)“(2,i),  i“l,2.  For  this  model,  it  is  sufficient  to  take  as  the 
component  S^(t)  in  the  vector  Z(t)  the  type  of  job  in  service  at  center  i 


I 


at  time  t,  rather  than  the  (type,  class)  pair.  Then  we  can  define  the 
vector  Z(t)  as 
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Z(t)  - (cJ^\t),c{^\t),S^(t),C^^\c),C^^\t),S2(t))  , 

where,  for  i«l,2  and  v-1,2, 

(t)  ••  number  of  type  V Jobs  tn  queue  at  center  i at  time  t, 

and 

S^(t)  ■ type  of  Job  in  service  at  center  i at  time  t 
0 if  center  i is  idle  at  time  t 

Letting  N^(t),  v»l,2  denote  the  position  from  the  top  of  the  type  v marked 
Job  in  the  linear  Job  stack,  the  state  vector  for  this  model  is 

X(t)  - (2(t),N^(t),N2(t)) , tsO  . 

Letting  L(t)  denote  the  last  state  visited  by  the  Markov  chain  X«{X(t):tiO} 
before  Jumping  to  X(t) , the  vector  V(t)  is 

V(t)  - (L(t),X(t)),  t20  . 

For  N-2  Jobs,  the  state  space  E of  the  process  {X(t):t20}  has  six 
states  and  is 

E - {(0,0, 0,1, 0,1, 2,1),  (0, 0,0,0, 1,2, 1,2),  (0, 0,1, 0,0, 2,1, 2) } 
u {(0,0,2,0,0,1.2,1),  (1,0, 1,0, 0.0, 2,1),  (0, 1,2, 0,0, 0.1, 2) } . 

The  subsets  and  of  E defining  the  start  of  response  times  for 

the  type  1 marked  Job  are 

aJ^^  - {(0,0, 0,1,0, 1,2,1),  (0,0, 2, 0,0, 1,2, 1)1 

A^^^  - {(0,0, 1,0, 0,2, 1,2),  (0,1, 2, 0,0, 0,1, 2)1  . 


il 
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(2)  (2) 

Similarly,  the  subsets  and  of  E defining  the  start  of  response 

times  for  the  type  2 marked  Job  are 

- {(0,0, 0,0, 1,2, 1,2),  (0,0, 1,0, 0,2, 1,2)} 

- {(0,0, 2, 0,0, 1,2,1),  (1,0, 1,0, 0,0, 2,1)}  . 

Since  and  are  response  times,  and  V-1,2; 

see  Figure  2.  It  is  easy  to  check  that  the  state  space  F of  the  process 
{V(t):tS:0}  has  nine  states.  The  subsets  S^'^^  of  F defining  the  starts  of 
response  times  for  the  type  V marked  job  are 

- {(0,0, 0,1, 0,1, 2, 1,0, 0,1, 0,0, 2, 1,2)} 

u {(0,0, 2, 0,0, 1,2, 1,0, 1,2, 0,0, 0,1, 2)}  i 

and 

- {(0,0, 0,0, 1,2, 1,2, 0,0, 2, 0,0, 1,2,1)} 

U {(0,0, 1,0, 0,2, 1,2, 1,0, 1,0, 0,0, 2,1)}  , 

respectively;  see  Figure  3.  Here  we  use  the  enumeration  of  the  six  states 
of  E given  in  Figure  2.  Thus,  e.g.,  (1,3)  denotes  the  state 
(0,0,0,1,0,1,2,1,0,0,1,0,0,2,1,2)£F. 

Results  obtained  by  simulation  of  this  model  for  75 , 

and  with  N'"2,  appear  in  Tables  1-4.  With 

these  parameter  values,  there  is  one  type  1 job  and  one  type  2 job.  The 
routing  and  service  requirements  of  the  two  job  types  are  the  same;  the 
two  jobs  differ  only  with  respect  to  the  non-preemptive  priority  given 
(at  each  center)  to  the  type  1 job.  The  simulation  used  the  congruential 


uniform  random  number  generator  described  by  Lewis,  Goodman,  and  Miller 
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[11],  with  exponenclal  service  cimes  obcalned  by  logarlchmic  transformation 
of  the  uniform  random  numbers.  Independent  streams  of  exponential  random 
numbers  (obtained  from  different  seeds)  were  used  to  generate  individual 
exponential  holding  time  sequences. 

In  Che  simulation  results  of  Tables  l-*4,  the  return  state  defining 
0-cycles  of  Che  response  time  for  the  type  1 Job  is  Che  state 
(0 ,0 ,2 ,0 ,0,1, 2, 1,0 ,1,2,0 ,0,0 ,1,2) . This  corresponds  to  a response  time 
for  the  type  1 (marked)  job  starting  when  Che  type  2 (marked)  job  is  in 
service  at  center  1.  Table  1 summarizes  results  of  the  simulation  and 
reports  point  estimates  and  90  percent  confidence  intervals  for  the 
quantities  and  E{r^^^ }-E{R^^^ } over  a range  of  number  of 

cycles  of  Che  type  1 marked  job.  Theoretical  values  for  these  quantities 
are  shown  in  parentheses.  Thus,  for  example,  100  cycles  of  the  type  1 
marked  job  were  observed  in  Che  simulated  time  interval  (0,903.00)  and 
there  were  a total  of  446  transitions  in  the  continuous  time  Markov  chain 
{L(t):c^0}.  A total  of  130  response  times  for  the  type  1 (marked)  job 
were  observed  along  with  56  response  times  for  the  type  2 (marked)  job. 

For  Che  quantity  E{R^^^}«7,  the  point  estimate  6.946  was  obcalned,  and 
Che  90  percent  confidence  interval  had  half-length  0.6334.  Note  chat  for 
and  all  of  the  confidence  intervals  surrounded  the 

theoretical  values.  In  the  case  of  E{R^^^}-E{r^^^ },  the  confidence 
intervals  based  on  equation  (3.6)  also  surrounded  the  theoretical  value. 
Table  2 gives  results  obtained  for  P{R^^^ix},  with  x*4,  8,  12,  16  and  20. 


t 
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In  Table  3 we  give,  for  the  several  values  of  x,  point  and  Interval 
estimates  for  P{R^^^sx}-P{R^^^Sx} , based  on  the  use  of  super-cycles  and 
equation  (3.8).  Thus,  for  x«4,  100  cycles  based  on  response  times  for 
the  type  1 job  resulted  in  37  super-cycles  defined  by  response  times  for 
the  type  2 job  greater  than  x.  Note  that  the  number  of  cycles  for  the 
type  1 marked  job  has  been  fixed,  and  for  each  x the  estimates  for 
P{R^^^Sx}-P{R^^^Sx}  computed  from  the  resulting  random  number  of 
super-cycles. 

(2) 

Table  4 contains  estimates  of  the  quantities  P{R^  ^^x}  obtained  from 
the  standard  regenerative  method  applied  to  these  super-cycles.  An  overall 
observation  from  Tables  2 and  4 is  that  the  lengths  of  confidence  intervals 
obtained  for  P{R^^^Sx}  and  P{R^^^Sx}  are  roughly  comparable. 

5.  CONCLUDING  REMARKS 

The  discussion  in  Section  3 concentrated  on  problems  associated  with 
the  estimation  of  characteristics  of  response  times  for  the  two  types  of 
jobs.  The  estimation  of  characteristics  of  two  passage  times,  or  one 
response  time  and  one  passage  time,  is  in  general  easier.  This  is  because 
there  is  the  possibility  of  forming,  from  0-cycles  based  on  one  type  of 
job,  super-cycles  which  terminate  when  no  passage  time  of  the  other  type 
of  Job  is  underway. 

We  have  considered  explicitly  only  the  case  of  two  job  types.  The 
estimation  methods  of  Section  3 apply  equally  well  to  networks  having  more 
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chan  two  job  types.  The  state  space  which  results  from  the  augmentation 

of  the  vector  X(t)  (by  components  to  track  a marked  job  of  each  of  the  i 

job  types)  is  of  course  larger. 

I 


-1 

1 

-I 
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simulation  Results  for  Response  Times  in  Closed  Networks  of  Queues 
With  Two  Job  Types.  Ni=l,  N2=l,  Xj^=l,  X2=.5. 
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TABLK  2 

Percentiles  of  Type  1 Response  Times  in  Closed  Networks  of  Queues 
With  T\»’o  Job  Types.  Nj^-1,  N?"!,  li'■.75,  A^*!,  A2“.5.  Return 
State  is  (0,0,2,0,0a,2,l,0,l,2,0.0,0,l,2). 


No.  of  Cycles  For  Type 

L Marked  Job 

100 

200 

400 

800 

1000 

P{R^^^s4} 

0.2384 

±0.0622 

0.2536 

±0.0417 

0.2555 

±0.0301 

0.2641 

±0.0217 

0.2639 

±0.0192 

P{R^^^S8} 

0.6692 

±0.0683 

0.6714 

±0.0444 

0.6717 

±0.0308 

0.6709 

±0.0221 

0.6802 

±0.0201 

P{r^^^s12} 

0.8923 

±0.0422 

0.8786 

±0.0293 

0.8332 

±0.0205 

0.8769 

±0.0159 

0.8330 

±0.0140 

P{R^^^il6} 

0.9461 

±0.0311 

0.9536 

±0.0198 

0.9594 

±0.0135 

0.9547 

±0.0105 

0.9605 

±0.0088 

P{R^^^S20} 

0.9923 

±0.0127 

0.9892 

±0.0100 

0.9915 

±0.0061 

0.9880 

±0.0052 

0.9898 

±0.0043 
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Percentiles  of  Type  2 Response  Times  in  Closed  Networks  of  Queues 
fith  Two  Job  Types.  Ni=l,  N?*!,  i^=.75,  Xi=l,  Return  State 


±0.0986  ±0.0582  ±0.0405  ±0.0284  ±0.0243 

No.  of  super-cycles  11  24  43  64  104 
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A PPENDIX 

9 

We  first  consider  estimation  of  the  variance  constant  0“  appearing  in 
equation  (3.6)  which  leads  to  a confidence  interval  for  }-E{R^^^ } . 

Based  on  n cycles,  for  i»l,2,  compute  as  an  estimate  of 

°11  " ” var{T^^^}-2r^^^cov{T^^\N^^^}+(r^^^^var{N^^^} 

according  to 

ft  - = 9p(l)Ji)  . -(l).2^(i) 

\i  " *11  ■ *12  ^ *22  • 


where 


E . 


with 


T - i E^,  . i E»;^'  -<■  8 

n j.l  J “ j=l  J 

Finally,  compute  3^2  estimate  of 


,(i) 


0^2  “ var{Tj^}-r^^^cov{Tj^,N^^^}-r^^^cov{Tj^,N^^^} 


-H  r(^^^2>cov{N<^\N;J2>} 


according  to 


k 
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®i2  ■ “a 


^ “i2  ^ 12  22  ’ 


where  3^j^»  **^2^  before,  aiid 


Then  estlmace  o according  Co 


2v2  ^11  ^22 

3 " — r— --  + 


2d 


12 


In  an  analogous  manner,  we  esClmace  Che  variance  conscanc  a (x) 
appearing  in  equacion  (3.8)  which  leads  Co  a confidence  incerval  for 


P{R^'^^Sx}-P{R^^^sx}  • Based  on  n super-cycles,  for  1-1,2,  compuCe 


as  an  esCimaCe  of 


O^^(x)  - var{Y|^^^}-2P{R^^^Sx}cov{Y^^\n^^h 


+ (P{R^^^Sx})^var{n^^^} 


according  Co 


OiiCx)  - 


■(! 


(i)  / "12 


(i)\  , /^(i)y  . 

sJ.Xx)  +1^1  «22  ^ 


where 


M) 


s.vrcx) 


) . 


and 


s-„ 


. _L_  VfnU)  -(l)v2 
J-1  ■' 


r 


2t> 


with 


;^(1) 


I ^,(i) 

n 1 
J-i  ■' 


and  a 


(O 


E 

j- 


(i) 

J 


Finally,  compule  (x)  aa  an  estimate  of 


0^2(x)  - cov{Y^^\Y^'^}-P{R^^^sx}covtV^^\n^^M 
- P(R^'^^x}cov{Y^^\n^“^} 

+ P{R^^^sx}P{R^‘^i.x}cov{n^^^ 


according  to 


- ,<{>w 


“-(is)-s’»-rs)-s 

,/y<^>-y<^>\ 


wliere  s^j^^(x),  s^;^^(x)  and  3^“^(x)  are  as  before,  and 

»22«  ■ ^ t • 

2 

Then  estimate  0*'(x)  according  to 

^2.  . ^322^*^^ 

a (x)  - TTT— T + 


(n<'^'  (n^2>)2  n<^>n(2> 


(x) 
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(i)  Services  at  centers  1 and  2 are  not  interruptable 

(ii)  Routing  for  type  v jobs  determined  by  binary  valued  variable 

(iii)  Type  1 jobs  have  non  preemptive  priority  over  type  2 jobs 


Figure  1.  Closed  network  of  queues  with  two  job  types. 


Figure  2.  State  transitions  in  Markov  chain  X and  subsets  of  E for  response 
times  R*’*  and  R*^'. 
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